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FIELD OF THE INVENTION 

The present invention relates to a display device, comprising an imaging layer 
with a plurality of picture elements and a lens layer comprising a plurality of lens elements 
for projecting light from different picture elements in the imaging layer to the left and right 
eyes of a user in order to provide an autostereoscopic effect, wherein each lens element 
comprises at least one lens cell which defines a closed space, having a ftont wall, facing the 
user, a hack wall facing the imaging layer and side walls, connecting the hack and front 
walls, the closed space heing filled with first and second substantially immiscible fluids 
having different refractive indices, each cell comprising means for varying the shape of the 
interface between the first and second fluids 

BACKGROUND OF THE INVENTION 

Such a device, based on the so called electrowetting effect, is disclosed in 
WO, 03/071335, A2. In order to provide a correct autostereoscopic image in such devices, a 
predetermined position of the users eyes in relation to the display device is assumed. If the 
user moves his head, and thereby bis eyes, out of the predetermined position, the image will 
be distorted. It would be possible to provide a display where a correct image is displayed at 
more than one allowed head position, but this requires a more complex imaging layer with 
higher resolution. Moreover, between the allowed head positions, the image is still not 
displayed correct to the user. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to wholly or partly solve the above 

mentioned problems. 

This object is achieved by a display device according to claim 1 and a method 

according to claim 9. 

More specifically, according to a first aspect, the invention relates to a display device, 
comprising an imaging layer with a plurality of picture elements and a lens layer comprising 
a plurality of lens elements for projecting light from different picture elements in the imaging 
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layer to the left and right eyes of a user in order to provide an autostereoscopic effect, 
wherein each lens element comprises at least one lens cell which defines a closed space, 
having a front wall, feeing the user, a back wall facing the imaging layer and side walls, 
connecting the back and front walls, the closed space being filled with first and second 
5 substantially immiscible fluids having different refractive indices, each cell comprising 

means for varying the shape of the interface between the first and second fluids. According to 
the invention the side walls of each cell comprise at least a first and a second individually 
controllable electrode, the display device comprises a tracking device for determining the 
position of a users head, and controlling means for controlling potentials of said first and 
1 0 second electrodes based on said position. 

This allows the display device to be adjusted in accordance with the user head 
movements, in order to display an autostereoscopic, three dimensional image correctly. 
Preferably, each lens element is elongated and covers a linear segment of the imaging layer 
from top to bottom and each lens element may comprise a single lens cell. This provides an 
1 5 arrangement with low complexity. 

In an alternative embodiment, each lens element may comprise a plurality of 
lens cells. This allows using fluids with more different densities. 

In the alternative embodiment, the lens cells may be individually controllable. 
This allows optionally different display modes, e.g. for the top and bottom parts of the 
20 display. 

In a preferred embodiment, the display device comprises selecting means for 
switching the display device into a 2D-mode, such that the controlling means makes the 
interlace between the first and second fluids to be substantially flat 

Preferably, the first fluid is an electrically conductive fluid, such as a salt 
25 water solution, the second fluid is a non conducting fluid, such as an oil, and the inner front 
and side walls are covered with an hydrophobic layer. This allows changing the shape of the 
interface between the first and second fluids using electrowetting. 

In a preferred embodiment the tracking device comprises a video camera. This 
allows the user head position to be determined using image analysis methods. 
30 According to a second aspect, the invention relates to a method for displaying 

an image with an autostereoscopic effect, comprising using a display device, comprising an 
imaging layer with a plurality of picture elements and a lens layer comprising a plurality of 
lens elements for projecting light from different picture elements in the imaging layer to the 
left and right eyes of a user, wherein each lens element comprises at least one lens cell which 
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defines a closed space, having a front wall, facing the user, a back wall facing the imaging 
layer and side wails, connecting the back and front walls, the closed space being filled with 
first and second substantially immiscible fluids having different refractive indices, each cell 
comprising means for varying the shape of the interface between the first and second fluids, 
wherein the side walls of each cell comprise at least a first and a second individually 
controllable electrode, determining the position of a users head using a tracking device, and 
controlling potentials of said first and second electrodes based on said determined head 
position. 

This method provides advantages similar to those of the display device. 
These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiments described hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig 1 and 2 illustrate schematically a concept for obtaining an autostereoscopic 

image. 

Fig 3 illustrates a display device according to an embodiment of the invention, 

comprising an image layer and a lens layer. 

Fig 4 illustrates a lens element in the display device of fig 3. 

Fig 5 illustrates, more detailed, a cross section through the lens element of fig 
4 and the corresponding part of the image layer. 

Fig 6 illustrates schematically the lens element in fig 4 in a first mode. 

Fig 7 illustrates schematically the lens element in fig 4 in a second mode. 

Fig 8 illustrates schematically the lens element in fig 4 in a third mode. 

Fig 9 illustrates the display device according to an embodiment of the 
invention comprising user head and eyes tracking means. 

Fig 10 illustrates schematically functional modules in a display device 
according to an embodiment of the invention. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig 1 and 2 illustrate schematically a concept for obtaining an autostereoscopic 
image. By an autostereoscopic image is meant an image that to a user appears to be 3- 
dimensional, without the use of special glasses. 

With reference to fig 1, a first image 1 is intended to be displayed to the left 
eye of a user, whereas a second image 2 is intended to be displayed to the right eye of a user. 
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Such images may be obtained e.g. by photographing an object with two offset cameras, much 
like the human eyes. It is of course possible to obtain such images in many other ways. 

From the first and second images 1,2 a composite image 3 may be obtained 
by interleaving thin vertical slices LI, L2, etc.; Rl, R2, etc. from the first and second images 
5 1, 2 in an ordered manner (from left to right: leftmost slice from second image, leftmost slice 
from first image, second leftmost slice from second image etc.). The composite image may 
be displayed e.g. using a liquid crystal display (LCD). 

Fig 2 illustrates an arrangement for projecting such a composite image, 
displayed by a liquid crystal display 4, to a users eyes 6, 7. The arrangement comprises a lens 

10 layer 5 including a plurality of juxtaposed, cylindrical plano-convex lenses. Each lens covers 
two slices R, L in the displayed composite image and serves to project light from a slice R 
towards the right eye 6 of a user, and light from a slice L towards the left eye 7 of a user. This 
resembles very much the concept used in so called "3D-Pbstcards", where the composite 
image is printed on paper and* the lens layer comprises a moulded plastic sheet. 

15 Fig 3 illustrates a display device according to an embodiment of the invention, 

comprising an image layer 9 and a lens layer 10. The image layer 9 preferably comprises a 
backlighted LCD-layer (LCD = Liquid Crystal Display), which per se is well known to the 
skilled person and will not be described in greater detail. The lens layer 10 comprises a 
plurality of juxtaposed elongated lens elements 1 1 , which extend in a vertical direction as 

20 seen by a user. Each lens element of fig 3 corresponds to one lens 5 in fig 2. Fig 3 is 

schematically drawn; a display device will in most cases comprise a considerably larger 
number of lens elements. 

Fig 4 illustrates a lens element in the display device of fig 3. In this 
embodiment, each element comprises one lens cell 12, as will be described later. However, 

25 each lens element 1 1 may in an alternative embodiment comprise more than one lens cell 
12a, 12b, 12c, as indicated by dashed lines in fig 4. These cells 12a, 12b, and 12c may be 
controlled together or individually. 

Fig 5 illustrates, more detailed, a cross section through the lens cell 12 of fig 4 
and the corresponding part of the image layer 9. A first 15 and a second 16 substrate 

30 accomplish a lens cell 12, which defines a closed space, having a front wall 17, facing the 
user, a back wall 18 facing the imaging layer 9 and side walls 19, 20, connecting the back 
and front walls 18, 17. The first and second substrates 15, 16 may be made of glass. 
The lens cell is filled with a first fluid 13 and a second fluid 14. The first fluid 13 may consist 
of water containing a salt solution, and the second fluid may consist of an oil, such as a 
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silicone oil or an alkane. The first and second fluids 13, 14 should preferably have 
substantially equal densities, in order to make the display orientation independent, however 
the density characteristics requirement may be somewhat reduced by dividing each lens 
element 1 1 into a plurality of lens cells, as indicated in fig 4. The walls used for this division 
may be treated such mat the contact angle of the interface between the fluids is 90° at each 
wall. This may be achieved by using a coating or an electrode that can be used to alter the 
contact angle electrically (electrowetting). The density of the first fluid 13 maybe adjusted 
by changing the salt concentration. The density of the second fluid 14 may be increased by 

adding molecular constituents. 

The first and second fluids 13, 14 should be substantially immiscible, as is the 
case with water and the above mentioned oils. Moreover their respective refractive indices 
should be substantially different. The first fluid 13 (salt solution) may have a refractive index 
in the range between 1 .32 and 1.50 depending on the salt concentration. Depending on which 
oil is used as the second fluid 14, the refractive index may vary between 1.25 and 1.70. In the 
illustrated embodiment, the first fluid 13 has a higher refractive index than the second fluid 
14, although an embodiment where the reversed relationship exists is also equally 
conceivable. The first fluid 13 is polar and conductive, whereas the second fluid 14 is 

electrically insulating. 

The side walls 19, 20 of the lens cell 12 each comprise an individually 
controllable electrode 21, 22. The back wall 18 comprises a back wall electrode 23, which is 
light permeable, or a small metal electrode that covers only a small part of the surface of the 
back wall 18. The electrodes are conductive and may consist e.g. of ITO (Indium Tin Oxide). 
The front 17 and side walls 19, 20 of the cell comprise a hydrophobic layer 24, which may 
consist of e.g. an amorphous fluorocarbon, such as TEFLON® API 600. The hydrophobic 
effect of this layer will, in a relaxed state, cause the first fluid 13 to wet as little as possible of 
the lens cell wall areas apart from the back wall 18. Thus the interface between the first and 
second fluids 13, 14 will constitute a meniscus, providing a particular contact angel 9 with 
the side walls 19, 20. As indicated in fig 5, the meniscus between the first and second fluids 
13 14 serves to refract incident fight such that the lens cell 12 functions as a positive lens. In 
an alternative embodiment, where the refractive index of the first fluid 13 is lower than the 
refractive index of the second fluid 14, the meniscus should curve in the opposite direction in 
order to provide a positive lens . 
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The hydrophobic layer (e.g. AF1600) also serves as an electrically insulating 
coating for the electrodes 21 and 22. In order to further improve the insulation, an extra 
coating may be deposited underneath the hydrophobic layer, for example a parylene coating. 
The shape of the meniscus, and the contact angle of each meniscus to side wall intersection 
may be altered by applying different potentials to the electrode 21 of the first wall 1 9, the 
electrode 22 of the second wall 20 and the back electrode 23. If a voltage Vl-Vb is applied 
between the electrode 21 of the first wall 19 and the back electrode 23, the conductive first 
fluid 13 is forced, by static electric force, to cover a greater area of the hydrophobic layer 24, 
which entails a different contact angle 0 and a differently shaped meniscus. 

Since the potentials Vl, Vr of the side wall electrodes 21, 22 are individually 
. controllable, it is not only possible to obtain a meniscus with variable convexity, but also a 
tilted meniscus, as will be described below. 

Fig 6 illustrates schematically the lens element in fig 4 in a first mode. In the 
first mode, the voltage V L -V B of the first electrode 21 is equal to the voltage V R -V B of the 
second electrode 22 (e.g. Vr— 50V ;Vi=-50V ;Vb=OV). In this mode, the lens element 1 1 is 
optimised for displaying content from left L and right R sub-images slices to the left and right 
eyes of a user, respectively, when the user is placed straight in front of the lens element 1 1 . 

Fig 7 illustrates schematically the lens element in fig 4 in a second mode. In 
the second mode, the voltage Vl-Vb of the first electrode 2 1 is greater than the voltage Vr- 
Vb of the second electrode 22 (e.g. V R =-75V ;V L =-25V ;V B =0V). This entails different 
contact angles 9 at the first 19 and second 20 side walls, and the meniscus is tilted. In this 
mode, the lens element 1 1 is optimised for displaying content from left L and right R sub- 
images slices to the left and right eyes of a user, respectively, when the user is laterally 
displaced to the right in relation to the lens element 1 1 as compared to the position in fig 6 
(dashed). 

Fig 8 illustrates schematically the lens element in fig 4 in a third mode. In the 
third mode, the voltage Vl-V b of the first electrode 21 is equal to the voltage Vr-Vb of the 
second electrode 22 (e.g. Vr=-100 V ;Vl=-100V ;V b =0 V). The voltages are chosen such, 
that the contact angle 0 at both side walls 19, 20 equals 90°. In this mode, the lens element 1 1 
does not function as a lens, but is optimised for displaying content two-dimensionally and at 
double resolution. That is, in the third mode the image layer is intended to display a regular 
image instead of a composite image. Selecting means, such as a button, may be provided on 
the display device for switching between 2D and 3D. Note that V B in all modes is 0 V, such 
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that the back electrode 23 may be connected to earth. However, other voltage combinations 

are of course possible. 

It is possible to add an extra lenticular sheet in front of the variable lenses in 

order to give the strength of the lenses a certain offset In case of a lenticular sheet with 
positive lenses, the electrowetting lenses should have negative strength when displaying two- 
dimensional content. 

Fig 9 illustrates the display device according to an embodiment of the 
invention comprising user head and eyes tracking means 26. In a preferred embodiment, the 
user head tracking means may comprise an image sensor, such as a video camera. The image 
sensor captures an image of the environment in front of the display device, in order to 

estimate the position of the user* s head and eyes. 

A number of methods for tracking head and eye positions using image analysis 
are known in the art. One possible method is to use skin colour segmentation to find the face 
of the user in the image, i.e. to distinguish an area in the image where the colour composition 
of the image deviates less than a predetermined threshold value from the expected colour 

composition of a face. 

If a face area has been detected, the location of the eyes in this area may be 
assumed, or a specific eye detection method may be used. Such a method may be based on 
the fact that most users blink both eyes simultaneously. This means that in successive image 
frames, two areas in the face provide fest and synchronised variations, which may be detected 

by an image analysis algorithm. 

The image sensor data may if needed be combined with data from a distance 
measurement sensor similar to those used in auto focus functions of regular cameras. 

Other image analysis based head tracking functions are described in the art, 
e.g. in US, 6580810, Bl. However, also other methods for determining the position of the 
users head and eyes would be conceivable, e.g. letting the user wear an object whose position 
may be determined using an electromagnetic field. 

Fig 10 illustrates schematically functional modules in a display device 
according to an embodiment of the invention. An image sensor 26 delivers image information 
to a processor unit 27. Based on the received information, the processor unit 27 determines 
the relative position of the users head vis-£-vis the display device. The processor unit 27 
together with the image sensor constitute head tracking means, or alternatively eye tracking 
means, if the processor unit 27 determines the user eye positions. 
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User head and/or eye position information thus achieved is fed from the 
processing unit 27 to a control unit 28. Based on the information received, the control unit 
feeds driving signals VR, VL, VB to the electrodes of the respective lens cells 12 in the lens 
layer 10 of the display device. The value of the driving signals may be calculated based on 
5 the position information, or may be retrieved for each lens cell from a lookup table. Note that 
the different lens cells 12 should receive different driving signals since their individual 
relative positions to the user's head are different 

It should be understood that various parts of the functional modules 26, 27, 28 
could be realised in different ways, e.g. as software routines executed by a processor, as 
10 ASIC hardware implementations etc. They could also be integrated with each other in 
different ways. 

In summary, the invention relates to an autostereoscopic display device, 
comprising an imaging layer and a lens layer. The lens layer serves to project different 
content from the imaging layer to the left and right eyes, respectively, of a user. The lens 

15 layer comprises lens cells, enclosing two fluids with different refractive indices. The shape of 
the interface between the fluids may be changed using electrowetting, by means of two 
individually controllable electrodes at the sides of each lens cell. The display device further 
comprises a user head tracking device and means for controlling the lens cell electrodes 
depending on a detected user head position. This allows the display device to display a 

20 correct 3D-image, even if the user moves his head. 

The invention is not restricted to the described embodiment It can be altered 
in different ways within the scope of the appended claims. 
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CLAIMS: 



1 Display device, comprising an imaging layer (9) with a plurality of picture 

elements and a lens layer (10) comprising a plurality of lens elements (1 1) for projecting light 
from different picture elements in the imaging layer (9) to the left and right eyes of a user in 
order to provide an autostereoscopic effect, wherein each lens element (1 1) comprises at least 

5 one lens cell (12) which defines a closed space, having a front wall (1 7), feeing the user, a 
back wall (18) facing fee imaging layer (9) and side waUs (19, 20), connecting fee back and 
front walls (1 7, 1 8), fee closed space being filled wife first (1 3) and second (14) substantially 
immiscible fluids having different refractive indices, each cell (12) comprising means for 
varying fee shape of fee interface between fee first (13) and second (14) fluids, wherein fee 

10 side walls (19, 20) of each lens cell (12) comprise at least a first (21) and a second (22) 

individually controllable electrode, fee display device comprises a tracking device (26, 27) 
for determining fee position of a users head, and controlling means (28) for controlling 
potentials of said first and second electrodes (21, 22) based on said position. 

! 5 2 . Display device according to claim 1 , wherein each lens element (1 1) is 

elongated and covers a linear segment of fee imaging layer from top to bottom. 

3 Display device according to claim 2, wherein each lens element (1 1) 
comprises a single lens cell (12). 

4 Display device according to claim 2, wherein each lens element (11) 
comprises a plurality of lens cells (12a, 12b, 12c). 

5 Display device according to claim 4, wherein said lens cells (12a, 12b, 12c) 
25 are individually controllable: 

6. Display device according to any of fee preceding claims, comprising selecting . 

means for switching fee display device into a 2D-mode such feat fee controlling means 
affects fee interface between fee first and second fluids (13, 14) to be substantially flat. 



20 
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7. Display device according to any of the preceding claims, wherein the first 
fluid (13) is an electrically conducting fluid, such as an aqueous salt solution, the second 
fluid (14) is an electrically non conducting fluid, such as an oil, and wherein the inner front 

5 and side walls (17, 19, 20) are covered with an hydrophobic layer (24). 

8. Display device according to any of the preceding claims, wherein the tracking 
device (26, 27) comprises a video camera (26). 

10 9. Method for displaying an image with an autostereoscopic effect, comprising 

using a display device, comprising an imaging layer with a plurality of picture 
elements and a lens layer comprising a plurality of lens elements for projecting light from 
different picture elements in the imaging layer to the left and right eyes of a user, wherein 
each lens element comprises at least one lens cell which defines a closed space, having a 

1 5 front wall, feeing the user, a back wall facing the imaging layer and side walls, connecting 
the back and front walls, the closed space being filled with first and second substantially 
immiscible fluids having different refractive indices, each cell comprising means for varying 
the shape of the interface between the first and second fluids, wherein the side walls of each 
cell comprise at least a first and a second individually controllable electrode, 

20 determining the position of a users head using a tracking device, 

and controlling potentials of said first and second electrodes based on said 
determined head position. 
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ABSTRACT: 



The present invention relates to an autostereoscopic display device, 
comprising an imaging layer (9) and a lens layer (10). The lens layer (10) serves to project 
different content from the imaging layer (9) to the left and right eyes, respectively, of a user. 
The lens layer (10) comprises lens cells (12), enclosing two fluids (13, 14) with different 
refractive indices. The shape of the interface between the fluids may he changed using 
electrowetting, by means of two individually controllable electrodes (21, 22) at the sides of 
each lens cell (12). The display device further comprises a user head tracking device and 
means for controlling the lens cell electrodes depending on a detected user head position. 
This allows the display device to display a correct 3D-image, even if the user moves his head. 
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